Skip to main content

Home/ CTLT and Friends/ Group items matching ""how to"" in title, tags, annotations or url

Group items matching
in title, tags, annotations or url

Sort By: Relevance | Date Filter: All | Bookmarks | Topics Simple Middle
Theron DesRosier

Virtual-TA - 2 views

www.virtual-ta.com/how-we-do-it.php

virtual ta outsource assessment

shared by Theron DesRosier on 07 Apr 10 - Cached
  • We also developed a technology platform that allows our TAs to electronically insert detailed, actionable feedback directly into student assignments
  • Your instructors give us the schedule of assignments, when student assignments are due, when we might expect to receive them electronically, when the scored assignments will be returned, the learning outcomes on which to score the assignments, the rubrics to be used and the weights to be applied to different learning outcomes. We can use your rubrics to score assignments or design rubrics for sign-off by your faculty members.
  • review and embed feedback using color-coded pushpins (each color corresponds to a specific learning outcome) directly onto the electronic assignments. Color-coded pushpins provide a powerful visual diagnostic.
  • ...5 more annotations...
  • We do not have any contact with your students. Instructors retain full control of the process, from designing the assignments in the first place, to specifying learning outcomes and attaching weights to each outcome. Instructors also review the work of our TAs through a step called the Interim Check, which happens after 10% of the assignments have been completed. Faculty provide feedback, offer any further instructions and eventually sign-off on the work done, before our TAs continue with the remainder of the assignments
  • Finally, upon the request of the instructor, the weights he/she specified to the learning outcomes will be rubric-based scores which are used to generate a composite score for each student assignment
  • As an added bonus, our Virtual-TAs provide a detailed, summative report for the instructor on the overall class performance on the given assignment, which includes a look at how the class fared on each outcome, where the students did well, where they stumbled and what concepts, if any, need reinforcing in class the following week.
  • We can also, upon request, generate reports by Student Learning Outcomes (SLOs). This report can be used by the instructor to immediately address gaps in learning at the individual or classroom level.
  • Think of this as a micro-closing-of-the-loop that happens each week.  Contrast this with the broader, closing-the-loop that accompanies program-level assessment of learning, which might happen at the end of a whole academic year or later!
  • Theron DesRosier on 07 Apr 10
     
    I went to Virtual TA and Highlighted their language describing how it works.
Corinna Lo

How People Learn: Brain, Mind, Experience, and School: Expanded Edition - 0 views

books.nap.edu/catalog.php

book learning

shared by Corinna Lo on 21 Dec 08 - Cached
  • Corinna Lo on 21 Dec 08
     
    This book offers exciting new research about the mind and the brain that provides answers to a number of compelling questions. When do infants begin to learn? How do experts learn and how is this different from non-experts? What can teachers and schools do-with curricula, classroom settings, and teaching methods--to help children learn most effectively? New evidence from many branches of science has significantly added to our understanding of what it means to know, from the neural processes that occur during learning to the influence of culture on what people see and absorb. You can read the entire book online for free.
Gary Brown

Under Obama, Accreditation Is Still in the Hot Seat - Government - The Chronicle of Higher Education - 1 views

chronicle.com/...124361

accountability market

shared by Gary Brown on 13 Sep 10 - No Cached
  • George Miller, a California Democrat who is chairman of the House education committee, said defining a credit hour is critical to ensure that students and taxpayers, through federal student aid, are not footing the bill for courses that are not worth the amount of credit being awarded.
    • Gary Brown
      Gary Brown on 13 Sep 10
       
      "Worth" opens up some interesting implications.  Intended I suspect, to dampen courses like basket-weaving, the production of outcomes cannot be far off, the production of economic impact related to those outcomes a step or less behind. 
  • Senators also questioned the independence of accreditors, which are supported by dues from member institutions and governed by representatives of the colleges they accredit.
  • Sen. Michael B. Enzi, the top Republican on the Senate Education Committee, has said he wants Congress to look beyond just problems in the for-profit sector. He said at a hearing last month that he would be "working to lay the groundwork for a broader, thorough, and more fair investigation into higher education" that would ask whether taxpayers are getting an appropriate value for the money they spend on all colleges.
  • ...10 more annotations...
  • State and federal governments are better equipped to enforce consumer protections for students, say accreditors, who have traditionally focused on preserving academic quality.
  • Judith S. Eaton, president of the Council for Higher Education Accreditation, which represents about 3,000 colleges, said that over the past several years accrediting organizations have responded to the growing calls for accountability and transparency from the public and lawmakers. The groups, she said, have worked to better identify and judge student achievement and share more information about what they do and how well the institutions are performing.
  • Peter T. Ewell, vice president of the National Center for Higher Education Management Systems, said the debate boils down to whether accreditors should serve primarily as consumer protectors or continue their traditional role of monitoring academic quality more broadly.
  • Richard K. Vedder, director of the Center for College Affordability & Productivity and a member of the Spellings Commission
  • "We should be moving to more of a Consumer Reports for colleges, to provide the public with information that the college rankings do imperfectly," he said.
  • accreditation will have to evolve to meet not only government's expectations but also the changing college
  • market
  • Nearly two years into the Obama Administration, colleges have not gotten the relief they expected from the contentious battles over measuring quality that defined the Bush Education Department.
  • Bracing for the prospect of new rules and laws that could expand their responsibilities, accreditors and the institutions they monitor are defending the self-regulation colleges use to ensure academic quality. But they are also responding to the pressures from the White House and Capitol Hill by making some changes on their own, hoping to stanch the possibility of more far-reaching federal requirements.
  • Advocates of change say the six regional and seven national accreditors have varying standards that are sometimes too lax, allowing for limited oversight of how credits are awarded, how much learning is accomplished, and what happens to the mission of institutions that change owners.
Gary Brown

Ethics? Let's Outsource Them! - Brainstorm - The Chronicle of Higher Education - 4 views

chronicle.com/...22408

rubrics. outsource

shared by Gary Brown on 09 Apr 10 - Cached
  • Many students are already buying their papers from term-paper factories located in India and other third world countries. Now we are sending those papers back there to be graded. I wonder how many people are both writing and grading student work, and whether, serendipitously, any of those people ever get the chance to grade their own writing.”
  • The great learning loop of outcomes assessment is neatly “closed,” with education now a perfect, completed circle of meaningless words.
  • With outsourced grading, it’s clearer than ever that the world of rubrics behaves like that wicked southern plant called kudzu, smothering everything it touches. Certainly teaching and learning are being covered over by rubrics, which are evolving into a sort of quasi-religious educational theory controlled by priests whose heads are so stuck in playing with statistics that they forget to try to look openly at what makes students turn into real, viable, educated adults and what makes great, or even good, teachers.
  • ...2 more annotations...
  • Writing an essay is an art, not a science. As such, people, not instruments, must take its measure, and judge it. Students have the right to know who is doing the measuring. Instead of going for outsourced grading, Ms. Whisenant should cause a ruckus over the size of her course with the administration at Houston. After all, if she can’t take an ethical stand, how can she dare to teach ethics?
  • "People need to get past thinking that grading must be done by the people who are teaching.” Sorry, Mr. Rajam, but what you should be saying is this: Teachers, including those who teach large classes and require teaching assistants and readers, need to get past thinking that they can get around grading.
  • Gary Brown on 09 Apr 10
     
    the outsourcing loop becomes a diatribe against rubrics...
  • Joshua Yeidel on 16 Apr 10
     
    It's hard to see how either outsourced assessment or harvested assessment can be accomplished convincingly without rubrics. How else can the standards of the teacher be enacted by the grader? From there we are driven to consider how, in the absence of a rubric, the standards of the teacher can be enacted by the student. Is it "ethical" to use the Potter Stewart standard: "I'll know it when I see it"?
  • Gary Brown on 16 Apr 10
     
    Yes, who is the "priest" in the preceding rendering--one who shares principles of quality (rubrics), or one who divines a grade a proclaims who is a "real, viable, educated adult"?
S Spaeth

MIT Press Journals - International Journal of Learning and Media - Full Text - 0 views

www.mitpressjournals.org/...ijlm.2009.0005

pbj ALT assessment co-development

shared by S Spaeth on 22 May 09 - Cached
  • Howard GardnerHobbs Professor of Cognition and Education, Project Zero, Harvard Graduate School of Education
  • As shown in table 1, we will be cognizant throughout of who the learners are, where they learn, how they learn, what are the principal curricula, and how competences are purveyed via the media of the time. The grid itself contains generalizations about the past and present, and speculation about the future, thus providing a broad portrait of changes over time. While we do not discuss each entry in the grid, we hope that it aids in thinking about learning in formal and informal settings.
  • Uniform schooling reflects both fairness and efficiency. It appears fair to treat all children in the same way; and it is also efficient, given classes of 20, 30, or even 60 charges in one room, sometimes arrayed by age, sometimes decidedly heterogeneous in composition.
  • ...6 more annotations...
  • It would be an exaggeration to claim that formal education takes place without attention to what has been learned about the processes of successful learning, such as insights into student motivation, study habits, strategies, metacognition, and other approaches obtained from experience, or, more recently and systematically, from the psychological and cognitive sciences. But it would probably be accurate to say that such accumulated knowledge is used only spottily and sporadically in most parts of the world. Education—teaching and learning—changes very slowly.
  • Yet, nowhere are these ideas dominant. Indeed, until today, one might say that the European classroom models of the 19th century continue to hold sway: Teachers give out information, students are expected to master it with little help, and the awards of the culture during the years of school go to those who can crack the various literate and disciplinary codes.
  • One strategy might involve formal education playing a role in informal learning spaces (perhaps on the analogy of teaching hospitals), and learners' out-of-school passions finding a validating place in formal educational arenas.
  • NDM's vast resources, including the provision of many activities in which the user assumes a formative role, can complement constructivist approaches to education. As noted above, a motivated learner can investigate a wide variety of personal interests on his or her own.
  • At this point in time, deeply constructivist classrooms remain few and far between despite evidence that hands-on, problem-solving approaches in the classroom result in higher levels of student engagement, conceptual thinking, knowledge transfer, and retention (Scardamalia, Bereiter, and Lamon 1994; Bransford et al. 1999; Hmelo-Silver 2004; Meier 1995; Project Zero and Reggio Children 2001; Sizer 1984). But in an environment of “No Child Left Behind” and standardized tests linked to federal funding, the implementation of constructivist principles in the classroom can be considered a risky enterprise for public schools.
  • A web-based project at MIT, for instance, paired French language students with peers in France learning to speak English, and provided students an authentic opportunity to practice their language skills, learn online communication skills, and negotiate the implicit guidelines of a different culture (Cultura 2007).
  • S Spaeth on 22 May 09
     
    In this article we argue that, after millennia of considering education (learning and teaching) chiefly in one way, we may well have reached a set of tipping points: Going forward, learning may be far more individualized, far more in the hands (and the minds) of the learner, and far more interactive than ever before. This constitutes a paradox: As the digital era progresses, learning may be at once more individual (contoured to a person's own style, proclivities, and interests) yet more social (involving networking, group work, the wisdom of crowds, etc.). How these seemingly contradictory directions are addressed impacts the future complexion of learning.
Gary Brown

Why Liberal Arts Need Career Services - Commentary - The Chronicle of Higher Education - 1 views

chronicle.com/...48973

careers

shared by Gary Brown on 04 Nov 09 - Cached
  • I have consulted with deans who say they really want to improve their career-services programs—but no, they can't offer career courses for credit, their professors aren't interested in supervising internships, and they must tread lightly around anything that might be seen by the faculty as encroaching vocationalism.
  • I've also heard from numerous professors, "Our good students go to graduate school. We don't need to focus on those who are looking for jobs."
  • I have also been told, "The professors are too busy teaching to worry about how the students will use their knowledge. It's not their job." And I've had more than one faculty member confess to me that they really aren't sure how what they teach applies in the nonacademic world.
  • ...6 more annotations...
  • There's no way to predict which moments of a liberal-arts education will be directly relevant in the workplace, but it's imperative that students know such moments occur frequently, and that the skills and knowledge they're learning are far from obscure and irrelevant.
  • We use visual-thinking techniques to help students connect the dots between their academic experience and the workplace.
  • But the opportunity to teach a career course that directly draws from a liberal-arts curriculum is not offered at many institutions. Instead, if courses are offered at all, they typically focus on basic job-finding skills like résumé writing and networking, serving to reinforce professors' worst beliefs about career advising: that it distracts and detracts from the educational process.
  • Professors, academic deans, and career-center staff members must work together. Learn what is happening in each other's shops. And don't have just a superficial conversation about services—instead, engage in a conversation about what is truly distinct about the curriculum, what students are learning, and how to make employers care.
  • Career-center personnel should find out what employers are seeking and what they say about your students.
  • If more liberal-arts faculties and career experts get together, watch out—the results could be amazing.
  • Gary Brown on 04 Nov 09
     
    As we work with CLA, perhaps inviting Careers Services to join as independent reviewers will help the effort
  • Joshua Yeidel on 05 Nov 09
     
    What seems to be missing here is inclusion of employers directly into the learning community. If professors "aren't sure how what they teach applies in the nonacademic world", get somebody directly involved who is, as one voice in the conversation, anyway. Of course this will be challenging to the professoriate, but it could also be revitalizing.
Gary Brown

Texas A&M's Faculty Ratings: Right and Wrong - Commentary - The Chronicle of Higher Education - 0 views

chronicle.com/...124330

accountability

shared by Gary Brown on 08 Sep 10 - No Cached
  • "Academia is highly specialized. We don't mean to be exclusive. We are a public-serving group of people. But at the same time, that public isn't well-enough aware of what we do and who we are to evaluate us."
  • But the think tank is correct that taxpayers deserve to know how their money is being spent. Public-university operating costs in Texas have gone up more than 60 percent in the last two decades, even after adjusting for inflation, and professors are among the state's highest-paid public employees. The state needs accountability measures, and they must be enforced by a party other than the faculty, who, it could easily be charged, have a conflict of interest. That's what Texas A&M got right.
  • Moosally is right about one thing: The public isn't well aware of what she and many of her colleagues do. But they should be. That is not to say that the public will be able to understand what goes on in all of the chemistry laboratories in Texas. But Moosally teaches English at a college that is not exactly tasked with performing cutting-edge research. Houston-Downtown's mission is to provide "educational opportunities and access to students from a variety of backgrounds including many first-generation college students."
  • ...7 more annotations...
  • No doubt there is useful research coming out of the university system. But plenty could be omitted without a great deal of detriment to students' education. For instance, Hugill's most recent contributions have included a chapter on "Transitions in Hegemony: A Theory Based on State Type and Technology" and the article "German Great-Power Relations in the Pages of Simplicissimus, 1896-1914." Moosally's master's thesis was titled "Resumptive Pronouns in Modern Standard Arabic: A Head-Driven Phrase Structure Grammar Account," and her current research interests include "interactions between grammar knowledge and writing abilities/interest [and] cross-linguistic patterns of agreement."
  • Only 35 percent of respondents felt it was very important for colleges to "provide useful information to the public on issues affecting their daily lives."
  • According to a 2004 survey by The Chronicle, 71 percent of Americans thought it was very important for colleges to prepare undergraduates for careers, while only 56 percent thought it was very important for colleges to "discover more about the world through research."
  • What Texas A&M officials have also missed is that faculty members must be held accountable for what they teach.
  • Professors receive more credit for teaching higher-level students. But again, that is backward. The idea should be to give senior faculty members more credit for teaching introductory classes.
  • Moreover, the metric entirely ignores teaching quality. Who cares how many "student hours" professors put in if they are not particularly good teachers anyway?
  • Ultimately there needs to be a systemic solution to the problem of teacher quality. Someone—a grown-up, preferably—needs to get into the classroom and watch what is being done there.
  • Gary Brown on 08 Sep 10
     
    Another one in which the comments say more than I might--but the range of these accountability pieces underscore the work to do....
Theron DesRosier

THE FUTURE OF EVERYTHING: - 0 views

feeds2.feedburner.com/academic-commons

shared by Theron DesRosier on 09 Mar 09 - Cached
  • Theron DesRosier on 09 Mar 09
     
    "In the face of an economic crisis of unprecedented and in many ways still not fully understood dimensions, there is a natural inclination to retrench, to stop considering what the next new thing might be, to slow down on innovation and experimentation. This is a mistake. This is the moment when we must confront the core assumptions of our educational enterprises, and to ask hard questions about why we do what we do, and how we can change in order to survive and perhaps even thrive. This symposium, which is part of the Future of Everything project hosted by Academic Commons (http://academiccommons.org/futureofeverything/), brings us together to consider the possible futures of a host of interconnected topics: the book, the library, our system of scholarly communication, classroom technology, software distribution, the lecture, the seminar, existing and future business models,and ultimately, the college and the university. You'll have a chance to hear from leading practitioners who are creating the next generation tools, resources, spaces, and policies, and to engage in on-line dialogue before, during, and after the event. The work of the symposium will be used to inform the publication of an on-line reader that we hope will be broadly useful for all engaged in re-imagining future services, facilities, and policies on campus. Date: May 19, 2009 Place: Norwood, MA"
Joshua Yeidel

Google Embraces Partners to Straddle Desktop-Cloud Divide - PC World Business Center - 2 views

www.pcworld.com/...addle_desktopcloud_divide.html

google cloud

shared by Joshua Yeidel on 12 Jan 10 - Cached
  • Joshua Yeidel on 12 Jan 10
     
    "Google has unveiled plans today to allow Google Docs to store any type of files, and revealed a new tool from Memeo to enable users to access, migrate, and synchronize files between their desktop and Google Docs. " (Snc tool is for Google Apps Premium only). Getting to be a more attractive option...
  • Matthew Tedder on 13 Jan 10
     
    Yes.. That is something I'd really like to use. My laptop warranty is out, they won't sell me any more extensions, one hard disk is loosing more and more sectors (and Maylee pulled off the right ALT key last night). Now only if Google Mail enabled me to build a number of views (filters) of my email (not just one), and Docs had inline revision viewing, I'd be ready to use it more. As it is, I use a variety of office apps because each seems to have strengths in different areas. I sometimes even move between apps with the same document. Mostly, I use OpenOffice, Google Docs, Microsoft Office, and LyX. LyX is the most philosophically advanced, I think.... but none escape the subjectivity of the matter. LyX removes any concern for how the document looks. You tell it what each information element is, not how it should look. Then you export to various formats and styles. Information search is vastly more powerful when all information elements are tagged according to what they are. And it produces just very beautiful content. OpenOffice has the broadest set of import/export capabilities and also with the best quality results, I'd say. All tables in all document types being accessible as database tables is also sometimes useful, as well as a variety of other capabilities. Google Docs is obviously best at collaboration but I find it sometimes frustrating to get formatting I want or working with revisions from others and myself. Microsoft Office is pretty high quality and full featured, as most realize, but lacks in import/export quality in comparison with some alternatives.
Jayme Jacobson

Fostering Learning in the Networked World: The Cyberlearning Opportunity and Challenge A 21st Century Agenda for the National Science Foundation - 0 views

209.85.173.132/search

core skill s 21st century learning transmedia navigation distributed cognition

shared by Jayme Jacobson on 11 Mar 09 - Cached
  • Participatory culture: 21st Century Media Education “We have also identified a set of core social skills and cultural competencies that young people should acquire if they are to be full, active, creative, and ethical participants in this emerging participatory culture:
  • Complex relations of “informal” and “formal” learning
  • We need far more knowledge on the development of learning interests and learning pathways over time and space - and their influences.
  • ...3 more annotations...
  • Play — the capacity to experiment with your surroundings as a form of problem-solvingPerformance — the ability to adopt alternative identities for the purpose of improvisation and discoverySimulation — the ability to interpret and construct dynamic models of real world processesAppropriation — the ability to meaningfully sample and remix media contentMultitasking — the ability to scan one’s environment and shift focus as needed to salient details.Distributed Cognition — the ability to interact meaningfully with tools that expand mental capacitiesCollective Intelligence — the ability to pool knowledge and compare notes with others toward a common goalJudgment — the ability to evaluate the reliability and credibility of different information sourcesTransmedia Navigation — the ability to follow the flow of stories and information across multiple modalitiesNetworking — the ability to search for, synthesize, and disseminate informationNegotiation — the ability to travel across diverse communities, discerning and respecting multiple perspectives, and grasping and following alternative norms.”
  • The power of the social: How do learners leverage social networks and affiliative ties? What positionings and accountabilities do they enable that matter for learning? The power of the setting: How do learners exploit the properties of settings to support learning, and how do they navigate the boundaries? The power of imagination: What possible courses of action do learners consider, as they project possible selves, possible achievements, and reflect on the learning they need to get there?
  • We have spent too much time in the dark about these issues that matter for learning experiences and pathways.
  • Jayme Jacobson on 11 Mar 09
     
    This is a great list of core competencies. Should use (cite) in forming the participatory learning strategies.
  • Theron DesRosier on 13 Mar 09
     
    Hey Jayme, Nice list. Another skill you talked about earlier was translation. Where does that fit? Is it a subskill of Negotiation?
Nils Peterson

Tom Vander Ark: How Social Networking Will Transform Learning - 2 views

www.huffingtonpost.com/...l-networking-wit_b_349467.html

learning web2.0 higher_education

shared by Nils Peterson on 12 Nov 09 - Cached
  • Key assumption: teacher effectiveness is the key variable; more good teachers will improve student achievement
  • I'm betting on social learning platforms as a lever for improvement at scale in education. Instead of a classroom as the primary organizing principle, social networks will become the primary building block of learning communities (both formal and informal). Smart recommendation engines will queue personalized content. Tutoring, training, and collaboration tools will be applications that run on social networks. New schools will be formed around these capabilities. Teachers in existing schools will adopt free tools yielding viral, bureaucracy-cutting productivity improvement.
    • Nils Peterson
      Nils Peterson on 18 Mar 10
       
      I just Diigoed UrgentEvoke.com (a game) and Jumo.com a new social site, each targeted at working on big, real-world problems.
  • Theron DesRosier on 12 Nov 09
     
    Vander Ark was the first Executive Director for the Bill & Melinda Gates Foundation. From his post: "There are plenty of theories about how to improve education. Most focus on what appear to be big levers--a point of entry and system intervention that appears to provide some improvement leverage. These theories usually involve 'if-then' statements: 'if we improve this, then other good stuff will happen.'" "One problem not addressed by these theories is the lack of innovation diffusion in education--a good idea won't cross the street. Weak improvement incentives and strong bureaucracy have created a lousy marketplace for products and ideas." "Key assumption: teacher effectiveness is the key variable; more good teachers will improve student achievement" "I'm betting on social learning platforms as a lever for improvement at scale in education. Instead of a classroom as the primary organizing principle, social networks will become the primary building block of learning communities (both formal and informal). Smart recommendation engines will queue personalized content. Tutoring, training, and collaboration tools will be applications that run on social networks. New schools will be formed around these capabilities. Teachers in existing schools will adopt free tools yielding viral, bureaucracy-cutting productivity improvement."
  • Nils Peterson on 18 Mar 10
     
    "Key assumption: teacher effectiveness is the key variable; more good teachers will improve student achievement" Vander Ark was the first Executive Director for the Bill & Melinda Gates Foundation. From his post:"There are plenty of theories about how to improve education. Most focus on what appear to be big levers--a point of entry and system intervention that appears to provide some improvement leverage. These theories usually involve 'if-then' statements: 'if we improve this, then other good stuff will happen.'" "One problem not addressed by these theories is the lack of innovation diffusion in education--a good idea won't cross the street. Weak improvement incentives and strong bureaucracy have created a lousy marketplace for products and ideas." "I'm betting on social learning platforms as a lever for improvement at scale in education. Instead of a classroom as the primary organizing principle, social networks will become the primary building block of learning communities (both formal and informal). Smart recommendation engines will queue personalized content. Tutoring, training, and collaboration tools will be applications that run on social networks. New schools will be formed around these capabilities. Teachers in existing schools will adopt free tools yielding viral, bureaucracy-cutting productivity improvement."\n\n\n
Nils Peterson

AAC&U News | April 2010 | Feature - 1 views

www.aacu.org/...feature.cfm

shared by Nils Peterson on 01 Apr 10 - Cached
  • Comparing Rubric Assessments to Standardized Tests
  • First, the university, a public institution of about 40,000 students in Ohio, needed to comply with the Voluntary System of Accountability (VSA), which requires that state institutions provide data about graduation rates, tuition, student characteristics, and student learning outcomes, among other measures, in the consistent format developed by its two sponsoring organizations, the Association of Public and Land-grant Universities (APLU), and the Association of State Colleges and Universities (AASCU).
  • And finally, UC was accepted in 2008 as a member of the fifth cohort of the Inter/National Coalition for Electronic Portfolio Research, a collaborative body with the goal of advancing knowledge about the effect of electronic portfolio use on student learning outcomes.  
  • ...13 more annotations...
  • outcomes required of all UC students—including critical thinking, knowledge integration, social responsibility, and effective communication
  • “The wonderful thing about this approach is that full-time faculty across the university  are gathering data about how their  students are doing, and since they’ll be teaching their courses in the future, they’re really invested in rubric assessment—they really care,” Escoe says. In one case, the capstone survey data revealed that students weren’t doing as well as expected in writing, and faculty from that program adjusted their pedagogy to include more writing assignments and writing assessments throughout the program, not just at the capstone level. As the university prepares to switch from a quarter system to semester system in two years, faculty members are using the capstone survey data to assist their course redesigns, Escoe says.
  • the university planned a “dual pilot” study examining the applicability of electronic portfolio assessment of writing and critical thinking alongside the Collegiate Learning Assessment,
  • The rubrics the UC team used were slightly modified versions of those developed by AAC&U’s Valid Assessment of Learning in Undergraduate Education (VALUE) project. 
  • In the critical thinking rubric assessment, for example, faculty evaluated student proposals for experiential honors projects that they could potentially complete in upcoming years.  The faculty assessors were trained and their rubric assessments “normed” to ensure that interrater reliability was suitably high.
  • “It’s not some nitpicky, onerous administrative add-on. It’s what we do as we teach our courses, and it really helps close that assessment loop.”
  • There were many factors that may have contributed to the lack of correlation, she says, including the fact that the CLA is timed, while the rubric assignments are not; and that the rubric scores were diagnostic and included specific feedback, while the CLA awarded points “in a black box”:
  • faculty members may have had exceptionally high expectations of their honors students and assessed the e-portfolios with those high expectations in mind—leading to results that would not correlate to a computer-scored test. 
  • “The CLA provides scores at the institutional level. It doesn’t give me a picture of how I can affect those specific students’ learning. So that’s where rubric assessment comes in—you can use it to look at data that’s compiled over time.”
  • Their portfolios are now more like real learning portfolios, not just a few artifacts, and we want to look at them as they go into their third and fourth years to see what they can tell us about students’ whole program of study.”  Hall and Robles are also looking into the possibility of forming relationships with other schools from NCEPR to exchange student e-portfolios and do a larger study on the value of rubric assessment of student learning.
  • “We’re really trying to stress that assessment is pedagogy,”
  • “We found no statistically significant correlation between the CLA scores and the portfolio scores,”
  • In the end, Escoe says, the two assessments are both useful, but for different things. The CLA can provide broad institutional data that satisfies VSA requirements, while rubric-based assessment provides better information to facilitate continuous program improvement.
    • Nils Peterson
      Nils Peterson on 01 Apr 10
       
      CLA did not provide information for continuous program improvement -- we've heard this argument before
  • Gary Brown on 01 Apr 10
     
    The lack of correlation might be rephrased--there appears to be no corrlation between what is useful for faculty who teach and what is useful for the VSA. A corollary question: Of what use is the VSA?
Gary Brown

News: More Meaningful Accreditation - Inside Higher Ed - 0 views

www.insidehighered.com/...accredit

accreditation portfolios

shared by Gary Brown on 22 Apr 09 - Cached
  • ts most distinctive feature is that it would clearly separate "compliance" from "improvement." Colleges would be required to build "portfolios" of data and materials, documenting (through more frequent peer reviews) their compliance with the association's many standards, with much of the information being made public. On a parallel track, or "pathway," colleges would have the flexibility to propose their own projects or themes as the focus of the self-improvement piece of their accreditation review, and would be judged (once the projects were approved by a peer team) by how well they carried out the plan. (Colleges the commission deems to be troubled would have a "pathway" chosen for them, to address their shortcomings.)
  • educe the paperwork burden on institutions (by making the portfolio electronic and limiting the written report for the portfolio to 50 pages), and make the process more valuable for colleges by letting them largely define for themselves where they want to improve and what they want to accomplish.
  • "We want to make accreditation so valuable to institutions that they would do it without Title IV," she said in an interview after the presentation. "The only way we can protect the improvement piece, and make it valuable to institutions to aim high, is if we separate it from the compliance piece."
  • ...3 more annotations...
  • Mainly what happens in the current structure, she said, is that the compliance role is so onerous and so dominates the process that, in too many cases, colleges fail to get anything meaningful out of the improvement portion. That, she said, is why separating the two is so essential.
  • s initially conceptualized, the commission's revised process would have institutions build electronic portfolios made up of (1) an annual institutional data update the accreditor already uses, (2) a collection of "evidence of quality and capacity" drawn from existing sources (other accrediting reports), federal surveys and audits, and a "50-page, evidence-based report that demonstrates fulfillment of the criteria for accreditation," based largely on the information in (1) and (2), commission documents say. A panel of peer reviewers would "rigorously" review the data (without a site visit) at various intervals -- how much more frequently than the current 10-year accreditation review would probably depend on the perceived health of the college -- and make a recommendation on whether to approve the institution for re-accreditation.
  • "The portfolio portion really should be what's tied to continued accreditation," said one member of the audience. "As soon as you tie the pathway portion into that, you make it a very different exercise, as we're going to want to make a good case, to make ourselves look good."
Gary Brown

An Expert Surveys the Assessment Landscape - Student Affairs - The Chronicle of Higher Education - 1 views

chronicle.com/...48945

shared by Gary Brown on 29 Oct 09 - Cached
    • Gary Brown
      Gary Brown on 29 Oct 09
       
      Illustration of a vision of assessment that separates assessment from teaching and learning.
  • If assessment is going to be required by accrediting bodies and top administrators, then we need administrative support and oversight of assessment on campus, rather than once again offloading more work onto faculty members squeezed by teaching & research inflation.
  • Outcomes assessment does not have to be in the form of standardized tests, nor does including assessment in faculty review have to translate into percentages achieving a particular score on such a test. What it does mean is that when the annual review comes along, one should be prepared to answer the question, "How do you know that what you're doing results in student learning?" We've all had the experience of realizing at times that students took in something very different from what we intended (if we were paying attention at all). So it's reasonable to be asked about how you do look at that question and how you decide when your current practice is successful or when it needs to be modified. That's simply being a reflective practitioner in the classroom which is the bare minimum students should expect from us. And that's all assessment is - answering that question, reflecting on what you find, and taking next steps to keep doing what works well and find better solutions for the things that aren't working well.
  • ...2 more annotations...
  • We need to really show HOW we use the results of assessment in the revamping of our curriculum, with real case studies. Each department should insist and be ready to demonstrate real case studies of this type of use of Assessment.
  • Socrates said "A life that is not examined is not worth living". Wonderful as this may be as a metaphor we should add to it - "and once examined - do something to improve it".
Theron DesRosier

Government Innovators Network: A Portal for Democratic Governance and Innovation - 0 views

www.innovations.harvard.edu

networked governance

shared by Theron DesRosier on 14 Nov 08 - Cached
  • Theron DesRosier on 14 Nov 08
     
    A Portal for Innovative Ideas This portal is produced by the Ash Institute for Democratic Governance and Innovation at Harvard Kennedy School, and is a marketplace of ideas and examples of government innovation. Browse or search to access news, documents, descriptions of award-winning programs, and information on events in your area of interest related to innovation. * RSS Feeds are available for each individual topic area. * We invite you to register to access online events, and to receive the biweekly Innovators Insights newsletter. * And, we encourage you to visit the Ash Institute YouTube Channel. The Ash Institute's Innovations in American Government Awards Program, and its affiliated international programs, are integral to the Government Innovators Network. Learn about the IAG program and how to apply.
Gary Brown

Evaluations That Make the Grade: 4 Ways to Improve Rating the Faculty - Teaching - The Chronicle of Higher Education - 1 views

chronicle.com/...65226

evaluating teaching

shared by Gary Brown on 27 Apr 10 - Cached
  • For students, the act of filling out those forms is sometimes a fleeting, half-conscious moment. But for instructors whose careers can live and die by student evaluations, getting back the forms is an hour of high anxiety
  • "They have destroyed higher education." Mr. Crumbley believes the forms lead inexorably to grade inflation and the dumbing down of the curriculum.
  • Texas enacted a law that will require every public college to post each faculty member's student-evaluation scores on a public Web site.
  • ...10 more annotations...
  • The IDEA Center, an education research group based at Kansas State University, has been spreading its particular course-evaluation gospel since 1975. The central innovation of the IDEA system is that departments can tailor their evaluation forms to emphasize whichever learning objectives are most important in their discipline.
  • (Roughly 350 colleges use the IDEA Center's system, though in some cases only a single department or academic unit participates.)
  • The new North Texas instrument that came from these efforts tries to correct for biases that are beyond an instructor's control. The questionnaire asks students, for example, whether the classroom had an appropriate size and layout for the course. If students were unhappy with the classroom, and if it appears that their unhappiness inappropriately colored their evaluations of the instructor, the system can adjust the instructor's scores accordingly.
  • The survey instrument, known as SALG, for Student Assessment of their Learning Gains, is now used by instructors across the country. The project's Web site contains more than 900 templates, mostly for courses in the sciences.
  • "So the ability to do some quantitative analysis of these comments really allows you to take a more nuanced and effective look at what these students are really saying."
  • Mr. Frick and his colleagues found that his new course-evaluation form was strongly correlated with both students' and instructors' own measures of how well the students had mastered each course's learning goals.
  • Elaine Seymour, who was then director of ethnography and evaluation research at the University of Colorado at Boulder, was assisting with a National Science Foundation project to improve the quality of science instruction at the college level. She found that many instructors were reluctant to try new teaching techniques because they feared their course-evaluation ratings might decline.
  • "Students are the inventory," Mr. Crumbley says. "The real stakeholders in higher education are employers, society, the people who hire our graduates. But what we do is ask the inventory if a professor is good or bad. At General Motors," he says, "you don't ask the cars which factory workers are good at their jobs. You check the cars for defects, you ask the drivers, and that's how you know how the workers are doing."
  • William H. Pallett, president of the IDEA Center, says that when course rating surveys are well-designed and instructors make clear that they care about them, students will answer honestly and thoughtfully.
  • In Mr. Bain's view, student evaluations should be just one of several tools colleges use to assess teaching. Peers should regularly visit one another's classrooms, he argues. And professors should develop "teaching portfolios" that demonstrate their ability to do the kinds of instruction that are most important in their particular disciplines. "It's kind of ironic that we grab onto something that seems fixed and fast and absolute, rather than something that seems a little bit messy," he says. "Making decisions about the ability of someone to cultivate someone else's learning is inherently a messy process. It can't be reduced to a formula."
  • Gary Brown on 27 Apr 10
     
    Old friends at the Idea Center, and an old but persistent issue.
Gary Brown

2 Efforts to Provide Data on Colleges to Consumers Fall Short, Report Says - Administration - The Chronicle of Higher Education - 2 views

chronicle.com/...64433

accountability

shared by Gary Brown on 02 Mar 10 - Cached
  • Higher education will have to be more accountable for its performance and more open to consumers about the actual cost of attending a college, and help people make easier comparisons among institutions, in order to succeed as the nation's economic engine, says a new report from two nonprofit think tanks here.
  • too little information to make informed choices about where they will get the most from their tuition dollars, say researchers at the two organizations, the libertarian-leaning American Enterprise Institute, and Education Sector, which is a proponent of reforming higher education
  • And without a more thorough and open form of accountability, institutions will not have any incentive to make the changes that will improve students' success,
  • ...7 more annotations...
  • "If existing flaws are not resolved, the nation runs the risk of ending up in the worst of all worlds: the appearance of higher education accountability without the reality," the authors say.
  • The two voluntary systems criticized in the study are the University and College Accountability Network, begun in September 2007 by the National Association of Independent Colleges and Universities to provide information about private colleges, and the Voluntary System of Accountability,
  • it does not obligate institutions to gather or reveal any data that are not already available elsewhere,"
  • associations are beginning to offer workshops and other opportunities for system participants to learn how to use the data they're collecting to improve the college experience for students, she said
  • VSA has the testing lobby written all over it
  • We may all appreciate the cultural context inhibiting public accountability but it is also important to understand that this same accountability is lacking internally where it effectively thwarts attempts to manage the institution rationally; i.e., informed with a continuous flow of mission-critical performance information. With the scant objective information at their command, college presidents and their associates must perform as shamans, reading the tea leaves of opinion and passion among stakeholders.
  • On balance, America's institutions of higher education function in a managerial vacuum.
  • Gary Brown on 02 Mar 10
     
    More of the same and the discussion is familiar--our challenge is to bring this topic to the attention of our points.
Joshua Yeidel

Scholar Raises Doubts About the Value of a Test of Student Learning - Research - The Chronicle of Higher Education - 3 views

chronicle.com/...65741

assessment accountability

shared by Joshua Yeidel on 02 Jun 10 - Cached
  • Beginning in 2011, the 331 universities that participate in the Voluntary System of Accountability will be expected to publicly report their students' performance on one of three national tests of college-level learning.
  • But at least one of those three tests—the Collegiate Learning Assessment, or CLA—isn't quite ready to be used as a tool of public accountability, a scholar suggested here on Tuesday during the annual meeting of the Association for Institutional Research.
  • Students' performance on the test was strongly correlated with how long they spent taking it.
  • ...6 more annotations...
  • Besides the CLA, which is sponsored by the Council for Aid to Education, other tests that participants in the voluntary system may use are the Collegiate Assessment of Academic Proficiency, from ACT Inc., and the Measure of Academic Proficiency and Progress, offered by the Educational Testing Service.
  • The test has sometimes been criticized for relying on a cross-sectional system rather than a longitudinal model, in which the same students would be tested in their first and fourth years of college.
  • there have long been concerns about just how motivated students are to perform well on the CLA.
  • Mr. Hosch suggested that small groups of similar colleges should create consortia for measuring student learning. For example, five liberal-arts colleges might create a common pool of faculty members that would evaluate senior theses from all five colleges. "That wouldn't be a national measure," Mr. Hosch said, "but it would be much more authentic."
  • Mr. Shavelson said. "The challenge confronting higher education is for institutions to address the recruitment and motivation issues if they are to get useful data. From my perspective, we need to integrate assessment into teaching and learning as part of students' programs of study, thereby raising the stakes a bit while enhancing motivation of both students and faculty
  • "I do agree with his central point that it would not be prudent to move to an accountability system based on cross-sectional assessments of freshmen and seniors at an institution," said Mr. Arum, who is an author, with Josipa Roksa, of Academically Adrift: Limited Learning on College Campuses, forthcoming from the University of Chicago Press
  • Gary Brown on 02 Jun 10
     
    CLA debunking, but the best item may be the forthcoming book on "limited learning on College Campuses."
  • Joshua Yeidel on 25 Jun 10
     
    "Micheal Scriven and I spent more than a few years trying to apply his multiple-ranking item tool (a very robust and creative tool, I recommend it to others when the alternative is multiple-choice items) to the assessment of critical thinking in health care professionals. The result might be deemed partially successful, at best. I eventually abandoned the test after about 10,000 administrations because the scoring was so complex we could not place it in non-technical hands."
  • Joshua Yeidel on 25 Jun 10
     
    In comments on an article about CLA, Scriven's name comes up...
Gary Brown

News: Different Paths to Full Professor - Inside Higher Ed - 1 views

www.insidehighered.com/...osu

SoTL research Tenure and Promotion

shared by Gary Brown on 11 Mar 10 - Cached
  • Ohio State is embarking on discussions on how to change the way professors are evaluated for promotion to full professor. University officials argue that, as in tenure reviews, research appears to be the dominant factor at that stage, despite official policies to weigh teaching and service as well.
  • The concept in play would end the myth that candidates for full professor (and maybe, someday, candidates for tenure) should be great in everything. Why? Because most professors aren't great at everything.
  • Once research eminence is verified, teaching and service must be found only to be "adequate."
  • ...3 more annotations...
  • This approach is insidiously harmful," Alutto said. "First, it generates cynicism among productive faculty, as they realize the 'game' being played. Second, it frustrates productive faculty who contribute to their disciplines and the university in unique and powerful ways other than -- or in addition to -- traditional research. Third, it flies in the face of everything we know about the need for a balanced portfolio of skills to achieve institutional success."
  • Measuring impact is always difficult, particularly when it comes to teaching and service," he said. "But it can be done if we focus on the significance of these activities as it extends beyond our own institution -- just as we expect such broad effects with traditional scholarship. Thus, indicators of impact on other institutions, recognition by professional associations, broad adoption of teaching materials (textbooks, software, etc.) by other institutions, evidence of effects on policy formulation and so on -- all these are appropriate independent indicators of effectiveness."
  • Gerber said, the idea of "counting" such contributions in faculty evaluations is an embrace of Ernest Boyer's ideas about "the scholarship of teaching," ideas that have had much more influence outside research universities than within them.
  • Gary Brown on 11 Mar 10
     
    Reconsidering SoTL at Ohio State
  • Kimberly Green on 29 Mar 10
     
    Responding to this portion: This approach is insidiously harmful," Alutto said. "First, it generates cynicism among productive faculty, as they realize the 'game' being played. Second, it frustrates productive faculty who contribute to their disciplines and the university in unique and powerful ways other than -- or in addition to -- traditional research. Third, it flies in the face of everything we know about the need for a balanced portfolio of skills to achieve institutional success." How does OAI navigate these real concerns / hurdles with our program assessment efforts? If we convince/force leadership to "value" teaching and SoTL but it carries little or no weight in terms of promotion and tenure (I give you Carol Anelli, for example), then don't we become part of that "game"?
Gary Brown

Book review: Taking Stock: Research on Teaching and Learning in Higher Education « Tony Bates - 2 views

www.tonybates.ca/...d-learning-in-higher-education

teaching

shared by Gary Brown on 09 Oct 10 - No Cached
  • Christensen Hughes, J. and Mighty, J. (eds.) (2010) Taking Stock: Research on Teaching and Learning in Higher Education Montreal QC and Kingston ON: McGill-Queen’s University Press, 350 pp, C$/US$39.95
  • ‘The impetus for this event was the recognition that researchers have discovered much about teaching and learning in higher education, but that dissemination and uptake of this information have been limited. As such, the impact of educational research on faculty-teaching practice and student-learning experience has been negligible.’
  • Julia Christensen Hughes
  • ...10 more annotations...
  • Chapter 7: Faculty research and teaching approaches Michael Prosser
  • What faculty know about student learning Maryellen Weimer
  • ractices of Convenience: Teaching and Learning in Higher Education
  • Chapter 8: Student engagement and learning: Jillian Kinzie
  • (p. 4)
  • ‘much of our current approach to teaching in higher education might best be described as practices of convenience, to the extent that traditional pedagogical approaches continue to predominate. Such practices are convenient insofar as large numbers of students can be efficiently processed through the system. As far as learning effectiveness is concerned, however, such practices are decidedly inconvenient, as they fall far short of what is needed in terms of fostering self-directed learning, transformative learning, or learning that lasts.’
  • p. 10:
  • …research suggests that there is an association between how faculty teach and how students learn, and how students learn and the learning outcomes achieved. Further, research suggests that many faculty members teach in ways that are not particularly helpful to deep learning. Much of this research has been known for decades, yet we continue to teach in ways that are contrary to these findings.’
  • ‘There is increasing empirical evidence from a variety of international settings that prevailing teaching practices in higher education do not encourage the sort of learning that contemporary society demands….Teaching remains largely didactic, assessment of student work is often trivial, and curricula are more likely to emphasize content coverage than acquisition of lifelong and life-wide skills.’
  • What other profession would go about its business in such an amateurish and unprofessional way as university teaching? Despite the excellent suggestions in this book from those ‘within the tent’, I don’t see change coming from within. We have government and self-imposed industry regulation to prevent financial advisers, medical practitioners, real estate agents, engineers, construction workers and many other professions from operating without proper training. How long are we prepared to put up with this unregulated situation in university and college teaching?
‹ Previous 21 - 40 of 215 Next › Last »
Showing 20▼ items per page